Papers with unidirectional language models
Consistent Bidirectional Language Modelling: Expressive Power and Representational Conciseness (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing bidirectional language models lack the ability to utilise future contexts and the pre-determined left-to-right generation order. |
| Approach: | They propose a class of bidirectional language models that are consistent by definition and can be efficiently used both for generation and scoring of sequences. |
| Outcome: | The proposed models are consistent by definition and can be efficiently used both for generation and scoring of sequences. |